System for the visually impaired to navigate a route through a facility

ABSTRACT

A system and method of the type for aiding a user in navigating a route through a facility so as too efficiently locate specific items within a facility is provided. The system includes a facility processor having a database and software stored thereon for mapping an interactive route from selected location to selected location within a facility, a label located proximate individual items, the label electronically communicating information specific to the item it is associated with, and a digital device having the interactive route electronically stored thereon, the digital device electronically communicating with the facility processor and the labels for tracking movement of the digital device along the route via communication with the labels and communicating a direction to move to follow the route.

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a divisional application of filed parent application Ser. No.09/802,703 filed with the United States Patent and Trademark Office onon Mar. 9, 2001, now U.S. Pat. No. 6,574,549, the teachings of which areincorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates generally to the field of electronicallyaided navigation through a facility and in particular to a method andapparatus for guiding visually impaired individuals along a route in afacility to obtain items or visit locations chosen by the individual.

BACKGROUND INFORMATION

Various methods and systems have been devised to aid visually impairedindividuals in unfamiliar surroundings. Devices and systems have beendeveloped in the past to guide the visually impaired by utilizingdetection devices to warn the user of obstacles. These prior art systemsmerely react and signal the user of obstacles and do not aid the user innavigating a route.

Other devices have been developed which aid visually impairedindividuals toward specific locations by utilizing remote moduleslocated at specific locations and a mobile module carried by theindividual recording distances and transmitting information to the user.Although these devices do aid visually impaired individuals to be moremobile and self-sufficient they do not allow for the user to detail hisown task list and have the system create a route for him to travel in amanner to efficiently accomplish the tasks on the list.

It would be a benefit therefore to have a navigation system that allowsan individual to create his own task list and have a route provided toaccomplish the tasks listed. It would be a further benefit to have anavigation system that allows an individual to create his own task listand electronically submit it to a service provider for the preparationand downloading of a route into the user's personal digital device so asto navigate the route and complete the tasks within a particularfacility. It would be a still further benefit to have a navigationsystem that is adapted for use with many existing electronic labelsystems currently existing in facilities.

SUMMARY OF THE INVENTION

It is thus an object of the present invention to provide a navigationsystem that allows an individual to create his own task list and have aroute provided for the individual to accomplish the tasks on the list.

It is a further object of the present invention to provide a navigationsystem that allows an individual to create his own task list andelectronically submit it to a facility for the preparation anddownloading of a route into the user's personal digital device so as tonavigate the route and complete the tasks within the particularfacility.

It is a still further object of the present invention to provide anavigation system that interacts with many systems already existing infacilities.

Accordingly, a system and method of the type for aiding a user innavigating a route through a facility so as too efficiently locatespecific items within a facility is provided. The system includes afacility processor having a database and software stored thereon formapping an interactive route from selected location to selected locationwithin a facility, a label located proximate individual items, the labelelectronically communicating information specific to the item it isassociated with, and a digital device having the interactive routeelectronically stored thereon, the digital device electronicallycommunicating with the facility processor and the labels for trackingmovement of the digital device along the route via communication withthe labels and communicating a direction to move to follow the route.

A user creates a list of items to acquire, or locations to visit thatare specific to a facility. The user then provides this list to afacility processor at the facility or via a network. An interactiveroute is then created to provide an efficient route for the user tolocate all the items on the list. This route is downloaded onto theuser's digital device for utilization in the facility. The systemutilizes two-way communication between the labels and the digital deviceand the digital device and the facility processor when necessary tonavigate through the facility. The digital device indicates a directionto follow until a listed item is located. The system may utilize anymeans necessary, such as visual, audio, and/or physical stimulation, tocommunicate to the user a direction to travel or when an item islocated. This system may be used by the visually impaired. Theinteractive route program may also allow the user to skip items or movethrough the list and select specific items, the route being adjustedaccording to the item selected.

The foregoing has outlined rather broadly the features and technicaladvantages of the present invention in order that the detaileddescription of the invention that follows may be better understood.Additional features and advantages of the invention will be describedhereinafter which form the subject of the claims of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present invention, and theadvantages thereof, reference is now made to the following descriptionstaken in conjunction with the accompanying drawings, in which:

FIG. 1 is an illustration of the navigation system of the presentinvention.

FIG. 2 is a system diagram of a data processing system, includinghardware and firmware, which may be used to implement the presentinvention.

FIG. 3 is an illustration of a navigation system of the presentinvention utilizing radio frequency (RF) communication.

FIG. 4 is a flowchart of a method of initiating the navigation system ofthe present invention.

FIGS. 5A, 5B, 5C is a flowchart of a method of the navigation system ofthe present invention.

DETAILED DESCRIPTION

Refer now to the drawings wherein depicted elements are not necessarilyshown to scale and wherein like or similar elements are designated bythe same reference numeral through the several figures.

FIG. 1 is an illustration of the navigation system of the presentinvention generally designated by the numeral 10. Navigation system 10includes a facility processor 12, a personal digital device 14, and afacility 16. System 10 as shown is adapted for use in a facility such asa grocery store or other sales facility. It should be recognized thatnavigation system 10 of the present invention may be utilized in manydifferent types of facilities, such as, but not limited to grocerystores, department stores, hardware stores, entertainment centers andthe like. For brevity and clarity navigation 10 is described forutilization in a grocery store for aiding visually impaired persons tonavigate shopping routes to obtain particular items.

Facility processor 12 may be a dedicated personal computer system, astore controller, or a manager's workstation. Facility processor 12 maybe a stand-alone processor or connected to other processors, such as,but not limited to, a corporate headquarters, through a network (notshown). Typically, facility processors will contain inventory data,facility location of inventory, price lists, and promotional offersamong other data necessary to operate a sales facility.

Personal digital device 14 is an independently powered, stand-alone,two-way wireless communication device. Personal digital device 14 may bea device such as, but not limited to, a personal digital assistant,laptop computer, cell phone or other similar device. Personal digitaldevice 14 will have software loaded to allow communication with facilityprocessor 12 and labels 18 (FIG. 3).

A representative hardware environment which can be used for practicingthe present invention is depicted with reference to FIG. 2, whichillustrates the hardware configuration of a data processing system 213in accordance with the subject invention. The representative system maybe utilized, in whole or in part, for various elements of the presentinvention such as facility processor 12, personal digital device 14, andlabel 18 shown in FIG. 3.

The data processing system 213 includes a central processing unit (CPU)210, such as a conventional microprocessor, and a number of other unitsinterconnected via a system bus 212. The data processing system 213includes a random access memory (RAM) 214 and a read only memory (ROM)216, and may include flash memory. Data processing system 213 may alsoinclude an I/O adapter 218 for connecting peripheral devices such asdisk units 220 and tape drives 240 to the bus 212, a user interfaceadapter 222 for connecting a keyboard 224, a mouse 226 and/or other userinterface devices such as a touch screen device to the bus 212, acommunication adapter 234 for connecting the data processing system 213to a data processing network 242, and a display adapter 236 forconnecting the bus 212 to a display device 238 which may include sound.The CPU 210 may include other circuitry not shown herein, which willinclude circuitry found within a microprocessor, e.g., an executionunit, a bus interface unit, an arithmetic logic unit (ALU), etc. The CPU210 may also reside on a single integrated circuit (IC).

FIG. 3 is an illustration of navigation system 10 of the presentinvention utilizing radio frequency (RF) communication. As shown,facility 16 includes facility processor 12 and a plurality of labels 18.Facility processor 12 contains stored information such as storeinventory, price lists, store diagrams, label 18 locations in thefacility, and promotional information. Facility processor 12 may includesoftware which allows mapping of the locations of labels 18 in facility16. Facility processor 12 is connected to one or more RF links 20 fortransmitting and receiving radio frequencies. It should be recognizedthat the system is described utilizing radio frequency, however,infrared technology or hard-wire communication may be utilized.

Each label 18 may be an independently powered, stand-alone, two-waycommunication device. Label 18 may be a radio frequency identificationtag. Labels 18 are placed along shelves, such as in a grocery store,adjacent to a product that it identifies. As represented in FIG. 3,labels 18 have been placed on two rows of shelves forming an aisle.Labels 18 may be loaded with information such as the location of label18, the item represented, item price, and promotional offers. Thisinformation may be pre-loaded and/or edited via communication fromfacility processor 12. Labels 18 may be programmed to transmitinformation back to facility processor 12.

The electronic label system as shown in FIG. 3 may be utilized withsystems available for use in retail facilities. The present inventionutilizes these in-place and readably available systems in-part, to aidthe visually impaired to shop in a self-sufficient and timely manner.

A user creates a task list and has an interactive route, created tolocate each item listed, loaded via a network or directly from facilityprocessor 12 at facility 16 into personal digital device 14. Once theroute is downloaded and the user and personal digital device 14 enter aparticular facility 16, personal digital device 14 polls labels 18within transmission range. When a label 18 is polled it will respondwith an item identification such as a barcode and may transmit alocation and additional information. When personal digital device 14receives the signal from a label 18, it processes the information sent,comparing it to the route identified and indicates to the user if it isa product he desires or may indicate that the user is to move forward orin a different direction. Personal digital device 14 may transmit thereceived barcode from a label 18 and send it to facility processor 12 toreceive the location of personal digital device 14 for routinginformation. The personal digital device may provide information to theuser utilizing audible, visible, and/or physical stimulation methodssuch as a synthetic voice, buzzers, vibration, braille display, orlights depending on the ability of the user.

By requesting as little information as possible from labels 18, thelabel's battery life is prolonged. Additionally, if the wireless linkbetween label 18 and personal digital device 14 is limited limited to avery short range, navigation system 10 can more accurately pinpoint thelocation of the shopper on the route.

FIG. 4 is a flowchart of a method of initiating navigation system 10 ofthe present invention described with reference to FIGS. 1 through 3. Ashopper creates a shopping list, step 410. The shopper then transmitsthe list to facility processor 12, step 420. The shopper may transmitthe list to facility processor 12 via a network or upload the list atfacility 16. The list may be a hard copy and scanned into facilityprocessor 12. In step 430, facility processor 12 compares the listeditems to the location of the items in the store and creates an optimalroute through facility 16 to obtain the items listed. The route may berecalculated during use if the user elects to skip an item listed. Instep 440, the route is loaded into personal digital device 14 of theuser either over a network or at facility 16.

FIG. 5A is a flowchart of a method of navigation system 10 of thepresent invention described in relation to FIGS. 1 through 4. Once theshopper has the route loaded into his personal digital device 14 ,heinitiates the programing and shopping route in step 510. In step 510,the shopper initiates the navigation program by inputting a request forthe first product. The shopper may input the request by typing it intothe personal digital device 14, utilizing voice recognition, utilizing adedicated key on the personal digital device 14, or any other methodknown to operate a computing device by the visually impaired. In step520, personal digital device 14 queries a label 18 for a barcode. Ifmore than one label 18 transmits a barcode, personal digital device 14accepts the strongest signal. In step 530, personal digital device 14queries label 18 for a location; if no location is transmitted fromlabel 18, the information is obtained from facility processor 12. Instep 540, if personal digital device 14 recognizes the barcode as anitem listed, the process continues as shown in FIG. 5B. If the barcodeis not recognized as an item desired, personal digital device 14compares the location of the previous label 18 with that of the currentlabel 18 location, step 550. In step 560, personal digital device 14determines if the shopper is moving in the correct direction. If theshopper is not moving in the correct direction, the correct direction iscalculated, step 570, and the correct direction is indicated to theshopper in step 590. If the shopper is moving in the correct direction,that direction is set in step 580 and is indicated to the shopper instep 590. This process is continued until the shopper locates the firstitem listed.

FIG. 5B is a flowchart of a method of navigation system 10 of thepresent invention described in relation to FIGS. 1 through 5A. FIG. 5Bis an illustration of the found product process of system 10. Once thebarcode transmitted from a label 18 matches an item listed, anindication is given to the shopper that the item is located, step 600.In step 610, personal digital device 14 inquires if the shopper respondsto the found item. If the shopper does not respond to personal digitaldevice 14, the barcode is again checked against the item listed, step620. If the barcode matches the listed item, the process resets to step600. This loop continues for a set number of times. If the barcode doesnot match the listed item, the process resets to step 520. If theshopper responds that the item is found, personal digital device 14queries if the shopper would like a price check, step 630. If price isrequested, personal digital device 14 queries label 18 and/or facilityprocessor 12 for the price, step 640. The price received is then storedin a running price total, step 650. Then system 10 is set to locate thenext item listed in step 660 and the process continues as shown in FIG.5C. If the shopper does not request a price in step 630, system 10 waitsa specified time for a response, step 670. If the preset wait timepasses, step 680, system 10 is set to the next product listed, step 660.If the shopper indicates by pushing a button or submits a response inanother manner established for another item in step 690, the methodcontinues as shown in FIG. 5C. If the shopper does not give anindication as to price request in steps 670-690, the program repeats aset number of times before moving to step 660.

FIG. 5C is a flowchart of a method of navigation system 10 of thepresent invention described in relation to FIGS. 1 through 5B. FIG. 5Cillustrates the next selection process which may be utilized at anytime,for example if the shopper decides to reduce the list because of timeconstraints or money concerns. In step 700, personal digital device 14provides for selection of a previous item or next item. This step mayalways be available by vocal command or by physical command and alsoincludes indications from personal digital device 14 to the shopper ofthe next item to pursue. Whichever direction the shopper chooses to gothrough the list, once an item is selected personal digital device 14calculates a route to the selected item, steps 710 and 720. In step 710,the shopper selects an item earlier in the list and the interactiveroute recalculates a route from the current location. In step 720, theinteractive route recalculates a route from the current location to theitem selected that is not the next listed item in the original list. Instep 730, the item is selected and the direction to move is indicated tothe shopper, step 740. The process then continues to step 510. Theprocess may be terminated upon the shoppers request or once all thelisted items have been found. Upon completion of the item list, digitaldevice 14 may indicate a route to a payment station and/or exit (notshown).

Although the present invention and its advantages have been described indetail, it should be understood that various changes, substitutions andalterations can be made herein without departing from the spirit andscope of the invention as defined by the appended claims. It should berecognized that the present method and system may be utilized by anyindividual to speed shopping or locating items in a facility. The labelmay be a wireless communication device that does not have the ability tovisually display information.

1. A system for aiding a user to navigate a route through a facilityhaving a plurality of selected locations comprising: a facilityprocessor having a database and software stored thereon for mapping aninteractive route from a first selected location to a second selectedlocation within said facility; a plurality of labels placed in proximityto individual items located within said facility, each of said labelselectronically communicating information specific to one of said items;and a digital device having said interactive route electronically storedthereon, said digital device communicating to said user andelectronically communicating with said facility processor and saidlabels for tracking movement of said digital device along saidinteractive route via communication with said labels and communicating adirection to move to follow said route, wherein said digital devicepolls at least one label of said plurality of labels for informationassociated with said labels, wherein said communication to user resultsin a vibration to a shopping cart.
 2. The navigation system of claim 1,wherein said digital device communication to said user is at least viaone of visual signals or audible signals.
 3. The navigation system ofclaim 1, wherein said digital device communication to said user is atleast via audible signals.
 4. The navigation system of claim 1, whereinsaid digital device tabulates a price of items selected and communicatessaid tabulated price to said user.
 5. The navigation system of claim 2,wherein said digital device tabulates a price of items selected andcommunicates said tabulated price to said user.
 6. The navigation systemof claim 1, wherein said digital device tabulates a price of itemsselected and communicates said tabulated price to said user.
 7. Thenavigation system of claim 3, wherein said digital device tabulates aprice of items selected and communicates said tabulated price to saiduser.
 8. A customer assistance system for a store that providesinformation to a shopper within said store by communicating signals tosaid shopper via a digital device, comprising: a facility processorhaving a database and software stored thereon for tracking aninteractive route of shopper from a first selected location to a secondselected location within said facility; a plurality of labels placed inproximity to individual items located within said facility, each of saidlabels electronically communicating information specific to one of saiditems; and a digital device in proximity to the shopper and in wirelesscommunication with said processor and said shopper to provide trackinginformation of interactive route of shopper to said processor, storetracking information of interactive route of shopper thereon,communicate assistive information to said shopper in response tointeractive route of shopper, and electronically communicate pollingdata to said processor by polling at least one label for iteminformation associated with said label, wherein said assistiveinformation is generated by processor in response to provided trackinginformation of interactive route of shopper and communicated pollingdata of at least one label, and said assistive information istransmitted by said processor to said digital device at a predeterminedtime for communication to said shopper; and wherein said communicationto shopper results in a vibration to a shopping cart.
 9. The navigationsystem of claim 8, wherein said communication to shopper is also byvisual display on said device.
 10. The navigation system of claim 8,wherein said communication to shopper is also by audible signal.
 11. Thenavigation system of claim 8, wherein said digital device tabulates aprice of items selected and communicates said tabulated price to saidshopper.
 12. The navigation system of claim 8, wherein said assistiveinformation is a signal suggesting a purchase option for said shopper inrelation to the interactive route of said shopper and polling data at apredetermined time.
 13. The navigation system of claim 12, wherein saidsignal is also an audible signal.
 14. The navigation system of claim 8,wherein said digital device is operable with a shopping cart and saidassistive information is initiated by physical stimulation to shoppervia said shopping cart and a visual or audible purchase option for saidshopper in relation to the interactive route of said shopper and pollingdata at a predetermined time.
 15. The navigation system of claim 8,wherein said assistive information is a visual display suggesting aroute for the shopper to follow in relation to the interactive route ofsaid shopper and polling data at a predetermined time.